Experimenting with Local LLMs on macOS
dev.to·7h·
Discuss: DEV
🖥️Self-hosted apps
Building Privacy-First AI Agents on Ollama: Complete Guide
nativemind.app·9h·
Discuss: Hacker News
🖥️Self-hosted apps
ProfilingAgent: Profiling-Guided Agentic Reasoning for Adaptive Model Optimization
arxiv.org·5h
🗃️SQLite
Adventures in C++ Game Architecture
hoboker.substack.com·12h·
Discuss: r/programming
🗃️SQLite
Ask HN: Why no inference directly from flash/SSD?
news.ycombinator.com·1d·
Discuss: Hacker News
🗃️SQLite
Unlocking On-Device AI: Verifying LLM Authenticity in the Palm of Your Hand
dev.to·5h·
Discuss: DEV
🖥️Self-hosted apps
MachineLearningLM: Continued Pretraining Language Models on Millions of Synthetic Tabular Prediction Tasks Scales In-Context ML
arxiv.org·5h
🗃️SQLite
False Confidence
theaiunderwriter.substack.com·15h·
Discuss: Substack
🖥️Self-hosted apps
Experimenting with local LLMs on macOS
blog.6nok.org·20h·
Discuss: Lobsters, Hacker News
🖥️Self-hosted apps
Ban&Pick: Achieving Free Performance Gains and Inference Speedup via Smarter Routing in MoE-LLMs
arxiv.org·5h
🗃️SQLite
Guardian AI: Verifying Billion-Parameter Models on the Edge by Arvind Sundararajan
dev.to·1h·
Discuss: DEV
🖥️Self-hosted apps
Import AI 428: Jupyter agents; Palisade’s USB cable hacker; distributed training tools from Exo
jack-clark.net·20h
🖥️Self-hosted apps
Prompt Engineering for Software Engineers
dev.to·4h·
Discuss: DEV
🗃️SQLite
NVIDIA Dynamo LLM Inference Framework
multimodalai.substack.com·3d·
Discuss: Substack
🗃️SQLite
Automated Dynamic Resource Allocation via Reinforcement Learning in Serverless Cloud Environments
dev.to·7h·
Discuss: DEV
🖥️Self-hosted apps
Load Llama-3.2 WebGPU in your browser from a local folder
simonwillison.net·12h·
Discuss: Hacker News
🖥️Self-hosted apps
COMPACT: Common-token Optimized Model Pruning Across Channels and Tokens
arxiv.org·5h
🗃️SQLite
Show HN: Claude Context but local – semantic code search without API keys
github.com·1d·
Discuss: Hacker News, r/ClaudeAI, r/LocalLLaMA
🗃️SQLite
Rootly joins Groq OpenBench with an SRE-focused benchmark
rootly.com·19h·
Discuss: Hacker News
🖥️Self-hosted apps
pathwaycom/llm-app
github.com·1d
🖥️Self-hosted apps